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Abstract — A construction of Crochemore, Mignosi and Restivo 
in the automata theory literature gives a presentation of a finite- 
type constrained system (FTCS) that is deterministic and has 
a relatively small number of states. This construction is thus a 
good starting point for determining the minimal deterministic 
presentation, known as the Shannon cover, of an FTCS. We 
analyze in detail the Crochemore-Mignosi-Restivo (CMR) con- 
struction in the case when the list of forbidden words defining 
the FTCS is of size at most two. We show that if the FTCS is 
irreducible, then an irreducible presentation for the system can 
be easily obtained from the CMR presentation. By studying the 
follower sets of the states in this irreducible presentation, we are 
able to explicitly determine the Shannon cover in some cases. In 
particular, our results show that the CMR construction directly 
yields the Shannon cover in the case of an irreducible FTCS with 
exactly one forbidden word, but this is not in general the case 
for FTCS's with two forbidden words. 



I. Introduction 

In the information theory literature, constrained systems 
have traditionally arisen in the context of coding for recording 
systems [4], [5], [6]. These systems, under the tag of regular 
languages, also form the cornerstone of automata and formal 
language theory in computer science [3, Chapters 3-4]. More 
recently, constrained systems have come up naturally in the 
context of code design for bio-molecular computation (see, 
for example, the survey paper [1]). 

To describe the aim of this paper, we need some basic 
terminology [5], [6] from the theory of constrained systems. 
Recall that a labeled graph, Q = (V, £ , C), is a finite directed 
graph with vertex set V, edge set £ C V x V, and edge 
labeling C : £ — > S, where E is a finite alphabet. We will 
refer to the vertices of Q as states. A constrained system 
(sometimes referred to as a constraint), S or S(Q), is the set of 
all finite-length sequences {words) obtained by reading off the 
labels along finite paths in a labeled graph Q. The constrained 
system S(Q) is said to be presented by Q; equivalently, Q 
is called a presentation of S(Q). A presentation, Q, of a 
constrained system S is said to be deterministic if at each state 
of Q, the outgoing edges are labeled distinctly. Deterministic 
presentations of a constrained system S are used to derive 
finite-state encoders for S (cf. [6, Chapter 4]). 
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In general, a given constrained system S has many different 
deterministic presentations. However, in practice it is often 
desirable to present S by a deterministic graph with the 
smallest possible number of states among all deterministic 
presentations of the constraint. Such a minimal presentation, 
called the Shannon cover of the constraint, can be used to 
find finite-state encoders with a small number of states which 
directly translates to low complexity of encoding into the 
constraint. The goal of this paper is to explicitly determine 
the Shannon cover of a certain class of constrained systems 
known as irreducible finite-type constraints. 

While even the Shannon cover is not in general unique for 
an arbitrary constrained system, it does turn out to be unique 
in the important case of irreducible constrained systems which 
we now define. A labeled graph Q with set of states V is said 
to be irreducible if for any pair of states s,t G V, there is a 
directed path in Q that begins at s and ends at t. A constrained 
system S is defined to be irreducible if it can be presented 
by an irreducible graph. Equivalently, S is irreducible iff for 
any pair of words u. w G S, there exists v G S such that 
the concatenation uvw is also in S. It is well known [6, p. 
57, Theorem 2.12] that the Shannon cover of an irreducible 
constrained system is unique up to labeled graph isomorphism. 

The Shannon cover of an irreducible constrained system 
S can be obtained from an irreducible deterministic presen- 
tation, Q, of S by a procedure known as state merging [6, 
Section 2.6]. This procedure is best described in terms of the 
follower sets of states. The follower set, F(s), of a state s 
in Q is the set of all finite-length words generated by paths 
in Q starting at s. Two states s and t in Q are said to be 
follower-set equivalent if F(s) = F(t). In such a situation, 
states s and t can be merged resulting in a new graph H 
obtained by first eliminating all edges emanating from t, 
redirecting into s all remaining edges entering t, and finally 
eliminating t. It is easily verified that the resulting graph H is 
also an irreducible deterministic presentation of S. Recursively 
carrying out the state merging procedure finally results in an 
irreducible deterministic presentation, /C, of S that is also 
follower-separated, which means that distinct pairs of states 
in K, have distinct follower sets. This graph K. is the Shannon 
cover of the constraint. In fact, a deterministic presentation of 
an irreducible constraint is the Shannon cover of the constraint 
iff it is irreducible and follower-separated. 



It is clear that the Shannon cover of a constraint S is 
very simply determined if the state merging procedure can be 
initiated on a presentation of S that already has a relatively 
small number of states. Such a presentation is obtained for 
a constrained system of finite type (defined below) via a 
construction of Crochemore, Mignosi and Restivo [2] which 
has origins in automata theory. The Crochemore-Mignosi- 
Restivo (CMR) construction is reasonably amenable to anal- 
ysis, and we use it as the starting point in our search for the 
Shannon cover of a constrained system of finite type. In fact, 
Crochemore et al. prove in a result [2, Theorem 14] related 
to the ones in this paper that their construction yields the 
Shannon cover for a certain type of finite-type constrained 
system. However, our results do not follow from theirs. 

Let S be a finite alphabet. We will denote by E* the set of 
all finite-length sequences (words) over E, including the empty 
word e. If x = XqX\ . . . Xt-\ is a word over E, then any of 
the subsequences x; L Xi + i . . .Xj, < i < j < £, is called a 
subword of x. By convention, the empty word e is a subword 
of any x 6 E*. A finite-type constrained system (FTCS) is 
characterized by a finite set T C E*, and is defined to be the 
set, S-v, of all words w G E* such that x does not contain as a 
subword any word in T. The finite set T is called a forbidden 
set, and its elements are called forbidden words. In this paper, 
we focus mainly on FTCS's with forbidden sets of cardinality 
at most two. The difficulties involved in extending our analysis 
further will already be apparent from the cardinality-two case. 

The rest of the paper is organized as follows. The CMR 
construction is described in Section II, and some useful prop- 
erties of this construction are given in Section III. Sections IV 
and V study the Shannon covers of FTCS's with one and two 
forbidden words, respectively. We show there that the CMR 
construction directly yields the Shannon cover in the case of 
an irreducible FTCS with exactly one forbidden word, but 
this is not in general the case for FTCS's with two forbidden 
words. Most of the results in this paper are stated without 
proof. Complete proofs of these results will be provided in 
the full version of the paper. 

II. The CMR Construction 

We fix a finite alphabet E, and let T C E* be a non-empty 
finite set. We assume that T is a non-redundant collection of 
words in that no word u G T is a subword of any w G T, 
w ^ u. Define a labeled graph XV = (V, £, C) as follows: 

• V = {w : w is a prefix of a word in J 7 }. Note that a 
prefix of a word x = x^xi . . . xt~\ is any of its subwords 
XqX\ . . . Xj for < j < £, or the empty word e. The 
states corresponding to w G T will be called sink states, 
and we will often refer to the state corresponding to the 
empty word e as the initial state. 

• There are no edges emanating from any sink state w G T. 
There are |E| edges, all having distinct labels, emanating 
from each state u G V\T. These edges are defined in 
the following manner: for each a G E, 

if ua G V, then the edge labeled a from u is a 
forward edge that terminates at the state ua; 




Fig. 1. The CMR automaton Vjr for T = {00,1101,111} and alphabet 
£ = {0, 1}. The squares represent the sink states. 



if ua ^ V, the edge labeled a from u is a backward 

edge that terminates at the state v, where v is the 

longest suffix (incl. the empty word e) of ua in V. 

The graph thus obtained will be referred to as the CMR 

automaton [2]. Figure ^ shows such a graph for T = 

{00, 1101, 111} and alphabet E = {0, 1}. 

Let Qjr be the graph obtained by deleting from XV all sink 
states and all edges entering sink states. It follows from [2, 
Theorem 10] that Qjr is a presentation of the FTCS Sjr having 
forbidden set T. We will refer to this graph Qjr as the CMR 
presentation of Sjr. It is easily seen that both XV and Qjr are 
deterministic. The CMR presentation for T = {00, 1101, 111} 
is the graph given in Figure |2j without the dotted edges. 

By construction, the number of states in XV is at most 
1 + X)wejp^( w )' anc ' nence > that in Qjr is at most 1 + 
^ weJr (£(w) — 1), where ^(w) denotes the length of the word 
w. Note that l + Ewe^W w ) ~ l ) < l^l C K , where Cax = 
max{£(w) : w G J 7 }. In comparison, the number of states in 
the canonical deterministic presentation of Sf obtained from 
the higher edge graph of order £ max of the unconstrained E- 
ary system [5] is |E| £max ~ 1 , which is typically much larger 
than l^l £ max . Thus, Q? is in general a better candidate on 
which to initiate the state merging procedure to construct the 
Shannon cover than the canonical presentation of Sp. 

III. Some Useful Properties of Q r 

In this section, we give some properties of the CMR 
presentation Qjr that will be useful in the subsequent 
development. We start with the following observation [2, 
Remark 6(1)], which is an easy consequence of the definitions 
of XV and <V- 



Lemma 3.1: For any non-initial state u 



Ur/Ui. 



ij-i, 



j > 0, in XV or Qjr, the edges entering u all share the same 
label Uj_i, which is the last symbol of u. Hence, a non-initial 
state in XV or Qjr has at most one self-loop attached to it. 

For the CMR automaton XV let 5 : (V\T) x E -> V be the 
transition function defined by setting <5(u, a), u G V, a G E, 
to be the state reached by the edge labeled a emanating from 
u. Note that if the edge labeled a starting at u is a forward 
edge, then 1 ^(5(u, a)) = £(ua) = £(u) + 1, and if it is a 
backward edge, then £(S(u, a)) < £(u). 

'Since states in "Djr and Qjr are identified with words in S*, the notation 
£(u) for a state u simply denotes the length of the word u. 





Fig. 2. The CMR presentation Q T for T = {00, 1101, 111} and alphabet 
X = {0, 1}. The dotted edges represent the failure function. 



Following [2], we will find it convenient to define the notion 
of & failure function, f : V \ (J- U {e}) — » V, recursively via 

. for each a G S, if <5(e, a)eV\f, then /(6(e, a)) = e; 

. for each UG V\(.FU {e}) and a G S, if<S(u,a) G V\F, 
then/(<5(u,a))=<5(/(u),a). 
Note that the failure function is not defined for the initial state 
and the sink states. The usefulness of the failure function stems 
from the fact that it helps in efficiently locating the terminal 
states of the backward edges in Vjr (and hence in Qjr). Indeed, 
if for some u G V \ {fF U {e}) and a G £, we have ua ^ V, 
then <5(u, a) = S(f(u), a). 

The states in the CMR presentation Qjr simply retain the 
failure function (as well as the transition function whenever 
it can be defined) from T>f. The dotted edges in Figure |2] 
represent the failure function for the states in <?{oo.iioi.iii}- 
We will follow this convention of using dotted edges to 
represent the failure function throughout the paper. 

We record in Lemma |3~2*1 and Proposition 13 . 3 1 below some 
facts about the failure function that we will use in later sections 
of the paper. 

For a state u ^ e in Qp, define A(u) = £(u) — £(f(u)). 

Lemma 3.2: Let u, v be non-initial states in Qjr such that 
u is a prefix of v. Then, A(u) < A(v). 

Proposition 3.3: For any state ua, with u G S* and a G S, 
in Qjr, we have /(ua) = u if and only if u = a* for some 
integer t > 0. 

Remark: By convention, a = e. 

Recall from Section I that if Sp is an irreducible constrained 
system, then the Shannon cover of Sf is obtained by applying 
the state merging procedure to an irreducible deterministic 
presentation of Sp. Now, Qjr is certainly deterministic, but 
need not always be irreducible. However, it does turn out to 
be so in most cases, as we shall see in Sections IV and V. The 
next lemma is a key component in our proofs of irreducibility. 

Given a state v in Qjr, let iV/(v) and Nb(v) respectively 
denote the number of forward and backward edges that 
emanate from v in the CMR automaton T>jr. 

Lemma 3.4: Let I > be an integer such that every state 
u in Qjr with £(u) < I has a path leading to a distinguished 
state w. If v is a state with l(y) =1 + 1 such that iV{,(v) > 1 
and either iV/(/(v)) < N b (v) or A(v) > 2 holds, then v has 
a path leading to w as well. 

The following result is an application of Lemma l3~4l 



Fig. 3. Q T for T = {a n } 



ofcs 




Fig. 4. Initial part of Q T for T = {ab r ay}, y G £*, 1 < r < n. -2 



Corollary 3.5: Let |S| > 3. If iV/(v) < (|E| - l)/2 for all 
states v in Gr, then Qjr is irreducible. 

The last lemma in this section gives an important necessary 
condition for two states in Q? to be follower-set equivalent. 
While it only applies to cases in which all forbidden words 
have the same length, it is enough for our purposes. 

Lemma 3.6: Let T C S* be a finite set with the property 
that all words in T have the same length. If x, y are a pair of 
states in Q? that are follower-set equivalent, then £(x) = £(y). 

Note that if T consists of exactly one word w, then the 
states of Qjr are precisely all the distinct proper prefixes of 
w, which are all of different lengths. We thus have 

Corollary 3.7: If \T\ = 1, then Q? is follower-separated. 

We investigate the case of forbidden sets of cardinality one 
in more detail in the next section. 

IV. The Case of One Forbidden Word 

When the forbidden set consists of exactly one forbidden 
word, we have a complete and concise result. 

Theorem 4.1: Let T = {w} for some w G S™, n > 1. If 
Sjr is irreducible, then Qjr is the Shannon cover of Sp. 

Proof: We have to show that Q? is irreducible and follower- 
separated. By dint of Corollary 13.71 it is enough to show that 
Qjr is irreducible whenever S? is. In fact, it is enough to 
consider the case of a binary alphabet S, since Corollary 13.51 
disposes of the |S| > 3 case. 

So, let S = {a, b}. Without loss of generality (WLOG), 
we may assume that the forbidden word w begins with the 
symbol a. Note that if w = ab n ~ l , then Sj? is not irreducible, 
since a, 6 n_1 G Syr, but there is no word x G {a, 6}* such 
that axb' 1 ^ 1 G Sjr. Similarly, Sjr is not irreducible when w = 
a™ _1 6. For all other words w, as we shall see, Qjr (and hence 
Sj:) is irreducible. 

We start with w = a™. It is easily seen that in this case, Qjr 
is as in Figure|3] which is seen to be irreducible by inspection. 

Next, let w = ab r ay, with y G S* and 1 < r < n — 2. 
We will show that all states in Q? have a path going to the 
initial state e. Figure |4] shows the subgraph of Q? containing 
the states from e up to u = ab r . Since there is an edge from 



u to e, we see that there is a path starting from any state 
between e and u that goes back to the initial state e. To see that 
this is also the case for states beyond u, we use Lemma l3~4l 
From Figure 0] we note that /(uo) = a. Thus, A(ua) = 
£(ua) - £(f(ua)) = £(u) > 2. Therefore, by Lemma El 
there is a path from ua to the initial state e. For states v with 
£(v) > £(ua), by Lemma [3~2l we have A(v) > 2 as well. So, 
repeated application of Lemma O. 41 shows that any such v also 
has a path going to the initial state e. Thus, Qj? is irreducible. 





Fig. 5. Initial part of Q r for T = {a r by}, ye£*,2<r<n-2 

Finally, let w = a r by, with y G £* and 2 < r < n - 2. 
Figure 13 shows the subgraph of Qjr containing the states from 
e up to u = a r b. We shall show first that there is a path to the 
initial state from the state u. Since /(u) = e, the backward 
edge from u, if labeled a, goes to the state a, and if labeled 
b, goes to the initial state. But since there is an edge from the 
state a to the initial state, there is always a path from u to e. In 
addition since A(u) = £(u) > 2, we also have A(v) > 2 for 
states v with £(v) > £(u), by Lemma l3~2l Thus, as before, 
repeated application of Lemma 13.41 shows that any such v 
also has a path going to the initial state e, proving that Q? is 
irreducible. This completes the proof of the theorem. ■ 

V. The Case of Two Forbidden Words 

When the forbidden set consists of more than one word, 
the analysis gets a lot more complicated. The intricacies of 
the analysis become evident even in the case of forbidden 
sets of size two. In this section, we consider forbidden sets 

T = {wi,W2} C £*, W[ ^ W2, With £(wi) = I!(W2). 

Furthermore, we will only present results for the case when 
|S| > 3, as the results for the binary alphabet do not have 
simple statements in many cases. For example, when |S| > 3, 
Qr is itself irreducible (Theorem 15. 1> . while in the binary 
case, we sometimes have to pass to a (proper) subgraph of 
Qjr to obtain an irreducible presentation of Sp. 

So, for the rest of this section, we will assume a finite 
alphabet £ with |S| > 3, and a subset T C X* consisting of 
two distinct equal-length words, wi and W2. We set p to be 
the longest common prefix (including the empty word e) of 
Wi and W2. Note that by construction, p is the only state in 
Qjr with two forward edges; all other states have at most one 
forward edge. We say that Qr forks at p, as Qjr forks into 
two branches "downstream" from p, as depicted in Figure [6] 

Theorem 5.1: If Sp is an irreducible FTCS, then Qyr is 
irreducible as a directed graph. 

Sketch of proof: If |S| > 5, then Corollary 13.51 gives us the 
irreducibility of Qjr. If |E| —4, then proving the irreducibility 
of Qjr is still a relatively easy application of Lemma l3~4l We 
skip the details. 



Fig. 6. A typical Qjr for \T\ = 2. Only forward edges are shown. 



So, suppose that S = {a, b, c}, and let f(wi) = <'(w2) = n, 
and £(p) = p. We will show that each state in Q? has a path 
leading to the initial state e. We divide the proof into three 
cases: (a) p = 0; (b) 1 < p < n — 2; and (c) p = n — 1. We 
give complete proofs for the first and last cases as illustrations, 
but skip the proof for Case (b). 

Case (a): p = 0. Here, the graph Qjr forks at the initial state 
itself. WLOG, the two forward edges from e are labeled a and 
b, respectively. It is enough to show that the states a and b 
each have a path going to the initial state. Indeed, if this can 
be shown, then it follows from Lemma l3~4l that the states v 
with ^(v) > 2 also have paths going to the initial state, as 
these states satisfy the conditions of that lemma. 

Suppose that one of the states a and b has an edge going to 
the initial state e. WLOG, let this state be a. The state b has 
two backward edges, of which at most one can be a self-loop 
by Lemma |3~T1 Thus, the other edge goes either to e or to a. 
In any case, b also has a path going to the initial state. 

We are left to deal with the situation when neither a nor b 
has an edge going to the initial state. In this situation, both a 
and b have self-loops, a has an edge going to b, and b has an 
edge terminating at a. It is straightforward to see that this can 
happen only if T = {acx, bey} for some x, y G £*, in which 
case the initial part of the graph Qjr is as in Figure \7\ 




Fig. 7. Initial part of Qjr for the case T = {acx., bey} for some x,y £ E*. 

Now, if x = y = c"~ 2 , then we have T — {ac 71 ^ 1 , 6c™ -1 }, 
in which case Sj^ is not irreducible, since a,c n ~ l G Sf, but 
there can be no z G {a, b, c}* such that azc" -1 G S^. So, 
assuming WLOG that x ^ c rl ~ 2 , there is a largest r < n— 1 for 
which ac r is a state; let u denote the state ac r corresponding 
to this largest r. As shown in Figure S(u, c) = e. Thus, the 
states a and b both have paths leading to the initial state, as 
can be verified from the figure. 

We have thus proved that Q? is irreducible whenever p = 0. 

Case (c): p = n - 1 . If p £ {a™- 1 , fe"" 1 , c"" 1 }, then Q? 
can easily be shown to be irreducible using Lemma l3~4l So, as- 
sume WLOG that T is either {a^b, a™"^} or {a n , a™-^}. 




Fig. 8. Q T for T = {a n ,a n ~ 1 b} and £ = {a, b, c}. 



Note, however, that when T = {a" 1 b,a n 1 c}, 5jr is not 



irreducible. When T = {a n 



l b}, Gr is as shown in 



Figure [8] and is clearly irreducible. 

Thus, by applying the state merging procedure to Qjr, we 
can obtain the Shannon cover of Syr. To do this, we must of 
course identify the states in Qjr that are follower-set equivalent. 
This also turns out to be a non-trivial task, and we are at 
present able to give a complete solution only in the special 
case when T = {a n , ax} for some x G S n_1 , x ^ a" -1 . 

In the following exposition, we set zi = a", and z 2 = ax 
for some x G £ n_1 , x ^ a" -1 . Note that we can parse z 2 
uniquely as 

z 2 = a Xl (1) a X2 (3^ . . . a**- 1 (3 {q - 1] a x " 

for some integer q > 2, where xi,$2,--- ,x q -\ are positive 
integers, x q is a non-negative integer, and /3^ G (E \ {a})* 
for j = 1, 2, . . . , q — 1. WLOG, we assume that (3^ begins 
with the symbol b ^ a. 

Figure [9] shows the generic structure of Qjr for 
T = {zi,Z2}. From Theorem 15.11 we know that Qjr is 
irreducible. And as stated in the next result, this presentation 
is also follower-separated when X\ > x q . 

Theorem 5.2: Let T = {z!,z 2 }. If X\ > x q , Qjr is 
follower-separated, and hence is the Shannon cover of Sjr. 

To state the corresponding result for the case when xi < 
x q , we need additional notation and terminology. For j = 
1, 2, . . . , q — 1, we define certain distinguished prefixes of z 2 , 

Pj = a 11 /3« a 12 /3 (2) . . . o*J (3 {3) a, 

and set po = a. The states pj in Qjr satisfy the following 
property. 

Lemma 5.3: For j > 0, f(pj) = Pfc for some k < j. 

Thus, we can define the set of indices 



Ind 



/ 



{k : f r (p q -i) = Pfc for some r > 1}, 



where f r (-) denotes the rth iterate of the failure function /. 
Note that G Ind/, since some iterate of the failure function 
will eventually take p g -i to po = a. 

For I = 0, 1, ... ,n — 1, let us define A; to be the set of 
all states u in Qjr such that £(u) = I. Thus, |A;| = 1 if 
I < x%, and | A; | = 2 if I > x\. We will often say that the 
states in A; are at level I in Qjr. Recall from Lemma 13.61 
that two states in Qjr are follower-set equivalent only if they 
are at the same level. We can now state the result for x\ < x q . 

Theorem 5.4: Let J- = {zi,z 2 }. If x\ < x q , define 

X = {xk+i : k G Ind/, k > 0, and x\ < Xk+i < X q }. 




Fig. 9. Typical Qjr for the case T = {a n , ax} for some x £ E" 



If X ^ 0, set x* = max^; else, set x* = Xi — 1. Then, 
the states at level ? > ^(pi) are follower-set equivalent iff 
I > ^(Pg-i) + x* . Consequently, the Shannon cover of S^ is 
obtained from Qjr by merging the pair of states at each level 



Theorems 15.21 and 15.41 completely specify the Shannon 
cover in the case of T = {zi,z 2 }. As a direct corollary of 
these theorems, we have the following result. 

Corollary 5.5: For T = {zi, z 2 }, the number of states, vjr, 
in the Shannon cover of Sp is given by 



VT 



2n- 

2n — x\ 



x\ — 1 

- (X q -X*) 



if X\ > X q 
if X\ < X q 



Generalizing the above result to arbitrary JF's of size two 
is by no means easy. We do have the following simple bound 
in the case of alphabets of size at least three, but finding 
tighter bounds or exact results remains an open problem. 

Theorem 5.6: Let T = {wi, w 2 }, for some Wi, w 2 G E n , 
wi / w 2 . Define p and a to be the lengths of the longest 
common prefix and the longest common suffix, respectively, 
of wi and w 2 . Then, the number of states, vjr, in the Shannon 
cover of 5jf can be bounded as 

2n — p — a — \ < vjr <2n — p — 1 



The results of Theorems 15.11 15.21 15.41 and 15.61 can be 

extended, upon appropriate modification, to binary alphabets 
as well. But as the statements in the binary case are a lot more 
dense, we do not present them in this paper. The results for 
the binary alphabet, as well as complete proofs of the results 
given here, will be published in the full version of this paper. 

References 

[1] A. Brenneman and A.E. Condon, "Strand design for bio-molecular 
computation," Theoretical Computer Science, vol. 287:1, pp. 39-58, 
2002. 

[2] M. Crochemore, F. Mignosi and A. Restivo, "Automata and forbidden 
words," Inform. Proc. Lett., vol. 67, pp. 111-117, 1998. 

[3] J.E. Hopcroft, R. Motwani and J.D. Ullman, Introduction to Automata 
Theory, Languages, and Computation, 2nd ed., Addison-Wesley, 2001. 

[4] K.A.S. Immink, Codes for Mass Data Storage Systems, 2nd ed., Rot- 
terdam, The Netherlands: Shannon Foundation Publishers, 2004. 

[5] B.H. Marcus, R.M. Roth and RH. Siegel, "Constrained Systems and 
Coding for Recording Channels," in Handbook of Coding Theory, R. 
Brualdi, C. Huffman and V. Pless, Eds., Amsterdam, The Netherlands: 
Elsevier, 1998. 

[6] B.H. Marcus, R.M. Roth and RH. Siegel, An Introduction to Coding for 
Constrained Systems, unpublished lecture notes. Available at http : // 
www. cs.technion.ac. il/~ronny/ const rained. html. 



